Stochastic Forward-Backward Splitting for Monotone Inclusions

نویسندگان

  • Lorenzo Rosasco
  • Silvia Villa
  • Bang Công Vu
چکیده

We propose and analyze the convergence of a novel stochastic algorithm for monotone inclusions that are sum of a maximal monotone operator and a single-valued cocoercive operator. The algorithm we propose is a natural stochastic extension of the classical forward-backward method. We provide a non-asymptotic error analysis in expectation for the strongly monotone case, as L. Rosasco DIBRIS, Università di Genova Genova, Italy [email protected] L. Rosasco, S. Villa (corresponding author) and B. C. Vũ Laboratory for Computational and Statistical Learning Istituto Italiano di Tecnologia and Massachusetts Institute of Technology, Cambridge, USA [email protected], [email protected] 2 Lorenzo Rosasco et al. well as almost sure convergence under weaker assumptions. For minimization problems, we recover rates matching those obtained by stochastic extensions of so called accelerated methods. Stochastic quasi Fejér’s sequences are a key technical tool to prove almost sure convergence.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Splitting Algorithm for Coupled System of Primal-Dual Monotone Inclusions

We propose a splitting algorithm for solving a coupled system of primal-dual monotone inclusions in real Hilbert spaces. The proposed algorithm has a structure identical to that of the forward-backward algorithm with variable metric. The operators involved in the problem formulation are used separately in the sense that single-valued operators are used individually and approximately in the forw...

متن کامل

Variable Metric Forward-Backward Splitting with Applications to Monotone Inclusions in Duality∗

We propose a variable metric forward-backward splitting algorithm and prove its convergence in real Hilbert spaces. We then use this framework to derive primal-dual splitting algorithms for solving various classes of monotone inclusions in duality. Some of these algorithms are new even when specialized to the fixed metric case. Various applications are discussed.

متن کامل

A first-order stochastic primal-dual algorithm with correction step

We investigate the convergence properties of a stochastic primal-dual splitting algorithm for solving structured monotone inclusions involving the sum of a cocoercive operator and a composite monotone operator. The proposed method is the stochastic extension to monotone inclusions of a proximal method studied in [26, 35] for saddle point problems. It consists in a forward step determined by the...

متن کامل

Asymmetric forward-backward-adjoint splitting for solving monotone inclusions involving three operators

In this work we propose a new splitting technique, namely Asymmetric Forward-Backward-Adjoint Splitting (AFBA), for solving monotone inclusions involving three terms, a maximally monotone, a cocoercive and a bounded linear operator. Classical operator splitting methods, like DouglasRachford (DRS) and Forward-Backward splitting (FBS) are special cases of our new algorithm. Among other things, AF...

متن کامل

Stochastic Approximations and Perturbations in Forward-Backward Splitting for Monotone Operators∗

We investigate the asymptotic behavior of a stochastic version of the forward-backward splitting algorithm for finding a zero of the sum of a maximally monotone set-valued operator and a cocoercive operator in Hilbert spaces. Our general setting features stochastic approximations of the cocoercive operator and stochastic perturbations in the evaluation of the resolvents of the set-valued operat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • J. Optimization Theory and Applications

دوره 169  شماره 

صفحات  -

تاریخ انتشار 2016